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METHOD AND APPARATUS FOR REDUCED SIZE IMAGE 

BACKGROUND OF THE INVENTION 

1. Field of Invention 

[0001] This invention is directed to reduced size image. 

2. Description of Related Art 

[0002] Reduced size images such as thumbnails are commonly used for 
conveniently viewing images without expending resources for supporting display of 
all the image data. Further improvements in generating reduced size images are 
needed. 

SUMMARY OF THE INVENTION 
[0003] Reduced size images may be generated by combining image data 
along dimensions that span an original image. For example, in two-dimensional 
images, picture elements (pixels) may be combined via an interpolation process to 
generate output pixels along each of x- and y-dimensions. While such processes may 
generate acceptable reduced size images (thumbnails), processing time required to 
generate such thumbnails may be higher than desired. 

[0004] To reduce the time required to generate reduced size images, 
dimensions that span the original image may be separated into a plurality of groups so 
that data in each group of one or more dimensions may be processed differently from 
data of other groups. For example, two-dimensional images may be spanned in the y- 
and x-dimensions so that picture elements (pixels) are arranged in rows and columns 
(lines of pixels and pixels along the lines), respectively. In this case, pixels of 
selected lines may be completely discarded or skipped while pixels of remaining lines 
may be processed along the x-dimension to obtain data of the reduced size image or 
thumbnail. 

[0005] The data may be processed via interpolation by multiplying a number 
of consecutive pixels by a corresponding weight, summing the results of the 
multiplication and dividing the sum by a normalizing factor. Further speed 
improvement maybe obtained by setting all the weights to unity (1) and summing 
over a power of 2 number of pixels. Limiting the number of pixels summed to a 
power of 2 simplifies the division to a binary shift. In this way, reduced size images 
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may be generated with greater efficiency and speed while controlling the quality of the 
reduced size image. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0006] Exemplary embodiments are described below with reference to the 
following figures, wherein: 

[0007] Fig. 1 shows an original document reduced down to a reduced size 

image; 

[0008] Fig. 2 shows an exemplary system diagram in which a reduced size 
image generator may operate; 

[0009] Fig. 3 shows an exemplary system diagram of the reduced size image 
generator shown in Fig. 2; 

[0010] Fig. 4 shows a table of exemplary parameters for controlling the 
reduced size image generator; 

[0011] Fig. 5 shows an exemplary two-dimensional pixel diagram for 
information printed on one document sheet; 

[0012] Fig. 6 shows line 4 of the pixel diagram of Fig. 5 and exemplary 
pixels selected to generate a first pixel of a reduced size image; 

[0013] Fig. 7 shows exemplary pixels selected for generating a second pixel 
of the reduced size image; 

[0014] Fig. 8 shows exemplary pixel selection that discards pixels; 

Fig. 9 shows pixel selection that requires replicating a last pixel of a 
line of the original image; 

[0015] Fig. 10 shows an exemplary process for discarding information in the 
y-dimension of the pixel diagram of Fig. 5; and 

[0016] Fig. 1 1 shows a method for generating a reduced size image. 
DETAILED DESCRIPTION 

[0017] Fig. 1 shows an original document converted to an original image 
reduced to a reduced size image. While Fig. 1 shows the original document, original 
image and the reduced size image as having two-dimensions, any number of 
dimensions may be included. For ease of discussion, the following discussion will 
use a two-dimensional example for clarity and familiarity, and the reduced size image 
may sometimes be referred to as a thumbnail or thumbnail image. 
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[0018] Fig. 2 shows an exemplary process where original documents are 
scanned by a scanner 100 generating original image data such as data in an RGB color 
space, for example. This color space may be converted to a YCC color space by a 
color converter 102. As is well known, the YCC color space includes a luminance 
component (Y) and two chromatic components (CC). The chromatic components 
may be subsampled at a 2:1 ratio, at least in one direction if not in both, so that there 
are half as many data points in the chromatic components as there are in the 
luminance components. The original image in the YCC color space may be input by a 
reduced size image generator 104 to generate a reduced size image. Other color 
spaces such as Lab, for example, may be used. 

[0019] Fig. 3 shows an exemplary block diagram of the reduced size image 
generator 104. The reduced size image generator 104 may include a CPU 106, a 
memory 108, a control parameter storage 1 10, an interpolator 1 12, a position 
controller 114 and an input/output port 116. The above components 106-1 16 may be 
coupled together via a bus 118. While the reduced size image generator 104 is 
illustrated using a bus architecture diagram, any other type of hardware configuration 
may be used such as using application specific integrated circuits (ASICs) to 
implement one or more of the components, or writing a computer program that 
executes in the CPU 106 to perform all the functions of the reduced size image 
generator, etc. 

[0020] The reduced size image controller 104 receives data of the original 
image and control parameters via the input/output port 116. The image data may be 
stored in the memory 108 and the control parameters may be stored in the control 
parameter storage 110. If the control parameter storage 1 10 is a non-volatile memory, 
the control parameters may be pre-stored in the control parameter storage 110 instead 
of being received via the input/output port 116. The original image data includes 
pixel values that are generated by the scanner 100. These pixels have predetermined 
positions relative to the original document. These positions may be determined 
relative to a reference point of the original document. For example, for a two- 
dimensional original document (e.g., an 8.5 x 1 1 sheet of paper), a predetermined 
reference point may be set to be the top left corner of the sheet of paper. All the pixels 
in the original image may be assigned a position relative to this predetermined 
reference point. 



4 Xerox Docket No. D/A3580 

[0021] Fig. 4 shows a table 200 of exemplary control parameters for two- 
dimensional original images that may be used to control the reduced size image 
generator 104. X_start and y_start parameters specify a starting position in the 
original document. For example, the color converter 102 may have replicated pixels 
along a perimeter of the original image for types of processing that require a context. 
Thus, x start and y__start parameters identify a position in the original document 
corresponding to a pixel in the original image (for example, a top left pixel in two- 
dimensions) that the reduced size image generator 104 may start generating a reduced 
size image. 

[0022] The x_start and y_start parameters may also be used to control an 
amount of the original image that may be used to generate a reduced size image. For 
example, placing the x_start and y_start at an interior point of the original document 
may effectively crop out portions of the original image that are not desired to be in the 
reduced size image. If the original image is a printed document having a header and a 
footer, for example, the x_start and y_start parameters may be used to identify a 
position that is below the header so that the header is not included in the reduced size 
image. 

[0023] The interpolation_size_and interpolationaverage parameters may be 
used to determine a number of pixels from an original image that are used to generate 
one pixel of the reduced size image. The interpolation size parameter specifies the 
number of consecutive pixels in the original image used to generate a single pixel in 
the reduced size image. (For original images of more than two-dimensions, the 
interpolation_size parameter may be a tuple of numbers specifying consecutive 
numbers of pixels in each dimension.) The interpolation_average parameter may be 
used as a normalization factor in the interpolation process. 

[0024] For example, if the interpolation_size parameter is 4, then 4 pixels 
along a line of the original image may be used to generate a single pixel in the reduced 
size image. Each of the pixels in the original image may be multiplied by a 
corresponding weight, the multiplication results summed and the sum divided by the 
interpolation_average. For a particularly efficient implementation, the 
interpolation_size parameter may be limited to a power of 2 and/or all interpolation 
weights set to unity (1). Under these conditions, the interpolation_average should be 
set to be a number of right shifts corresponding to the power of 2 specified by the 
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interpolation_size. Thus, if the interpolation_size is equal to 4, then the 
interpolation_average is equal to 2. For this example, 4 pixels in the original image is 
summed and then the sum is right shifted by 2 to obtain a single pixel in the reduced 
size image. 

[0025] The x_increment and y increment parameters may be used to 
determine a position within the original document from which a next set of pixels in 
the original image may be selected to generate a next pixel of the reduced size image. 
For example, if pixels in the original image were generated by the scanner 100 having 
fast and slow scan directions, pixels in the fast scan direction (e.g., left to right in the 
x-dimension) for each line (y-dimension) maybe selected for interpolation. When the 
end of a current line is reached, a next line in the slow scan direction may be selected. 
Thus, if interpolation_size = 4 and the x-position and the y-position indicate a current 
position of a current line that corresponds to a current pixel, then the current pixel and 
three consecutive pixels following the current pixel may be selected for interpolation 
to generate a next pixel of the reduced size image, the x position is incremented by 
x_increment to obtain a position of a next set of 4 pixels in the current line to generate 
a next pixel of the reduced size image. When the end of the current line is reached, 
the y_position is incremented by y_increment for a position in the y_dimension of a 
new current line, and the x_position is reset to x__start to obtain a position of a next set 
of 4 pixels. This process continues until all the pixels of the reduced size image are 
generated. The relationship between x_ and y_positions and a corresponding pixel is 
explained in connection with Fig. 5 below. 

[0026] X count and y_count parameters identify which pixels in the reduced 
size image is being output by the reduced size image generator 104. For example, as 
the reduced size image generator 104 processes pixels in the original image along the 
x-dimension, the x_count is incremented by 1 for each pixel generated in the reduced 
size image. When the end of the current line in the original image is reached and 
x_position is set to x_start, x_count may be reset to a predetermined value such as 0 
and y_count incremented by 1 . 

[0027] A linewidth parameter specifies a number of pixels in a line (the x 
dimension) that could be used to generate the reduced size image. Thus, similar to the 
x_start and y_start parameters, the line_width parameter may be used to crop out 
portions of the original image so that they are not used to generate the reduced size 
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image or simply indicate the number of pixels in a line. For the remainder discussion, 
x_position, x ^position parameter or x_position value may be used interchangeably to 
indicate the position in the x-dimension. Similar usage is made for all other 
parameters. 

[0028] Fig. 5 shows a pixel diagram for an original image having 3900 pixel 
positions in the x-dimension and 1350 pixel positions in the y-dimension. As 
indicated in the top and left numeral sequences, the pixel positions in the x- and y- 
dimensions are numbered starting with 0 from left to right and top to bottom. 

[0029] The x_start and the y_start parameters are referenced from a 
predetermined reference point in an original document. This predetermined reference 
point may be a position of a top-left-most point. This position may correspond to a 
top-left-most pixel in the original image, but does not necessarily have to correspond 
to any pixel position (which may be an integer, for example) on the original scanner 
grid. Also, the x start and y_start parameters may have a value that is not an integer 
multiple of a pixel separation distance between adjacent pixels. As shown in Fig. 5, 
the predetermined reference point 300 is not at the top-left-most pixel position and the 
magnitudes of the x_start and y_start parameters are not integer multiples of pixel 
separation distances in the x- and y-dimensions. Similarly, the x_increment and 
y increment may have a value that is not an integer multiple of the pixel separations 
in the x- and y-dimensions. 

[0030] Because the x_start, y_start, x_increment and y_increment 
parameters may have values that are not integer multiples of the pixel separation 
distances in the x- and y-dimensions, the x ^position and y_position parameters may 
be used to keep track of an exact current position within the original document and 
x _pixel and y_pixel parameters may be used to identify a current pixel within the 
original image. The x_pixel is the pixel number (column number) when counting 
from left to right where x_pixel = 0 identify the left most pixel in a line. Y_pixel 
identifies the current line where y_pixel = 0 identifies the top line in the original 
image. The x_j>ixel parameter is set to the x position parameter rounded to the nearest 
integer position. When the x_position is exactly between two pixel positions, its 
value is rounded downwards to obtain the x_pixel value. Fig. 5 shows that the 
x_position is closest to pixel 3. Thus, xjpixel value is set to 3. Similarly, y_pixel 
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value is set to the y_position value rounded to the nearest integer and identifies the 
current line. 

[0031] Fig. 5 shows that the y_position value is closest to line 4. Thus, 
y_pixel value is set to 4. Accordingly, for the example shown in Fig. 5, the pixel at 
(x=3,y=4) is the first of 4 pixels (if interpolation_size=4) used to generate a first pixel 
in the reduced size image. Thus, the x_position and interpolation_size defines a 
neighborhood in which pixels are selected for generating a pixel in the reduced size 
image. The boundaries of the neighborhood are defined as discussed above. 

[0032] Returning to Fig. 3, the position controller 114 identifies data points 
(e.g., pixels) of an original image to be used to generate a reduced size image such as 
a thumbnail image. The interpolator 1 12 generates output data points (e.g., pixels) of 
the reduced size image based on the data points identified by the position controller 
1 14. When starting a reduced size image generation process, the CPU 106 may 
instruct the position controller 1 14 to retrieve needed parameters from the control 
parameter storage 110 and to maintain the x_position, y_position, x_pixel and y_pixel 
values. The x_pixel and y_ pixel values are used to retrieve appropriate pixel values 
of the original image from the memory 108 and, upon instruction from the CPU 106, 
the retrieved pixel values are provided to the interpolator 112 which begins generation 
of the interpolated values for the reduced size image. While the above describes that 
the original image is stored in the memory 108, the reduced sized image may be 
generated on the fly directly from the output of the scanner 100 (if no color conversion 
is needed) or from the output of the color converter 102. In this case, the original 
image need not be stored in the memory 108, but only intermediate values need to be 
temporarily stored. Memory may be needed to hold the interpolation sum such as 
registers in the CPU 106, for example. 

[0033] After each pixel of the reduced size image is generated by the 
interpolator 1 12, the position controller 1 14 increments the x_position by x_ihcrement 
and updates the x_pixel value. The position controller 114 then retrieves appropriate 
pixels of the original image from the memory 108 and provides them to the 
interpolator 1 12 for generating a next pixel value of the reduced size image. This 
process continues until all the pixels corresponding to the current line identified by the 
y_pixel value is exhausted, or until a predefined number of reduced size image pixels 
in the x-dimension is reached whichever comes first. The predefined number may be 
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an additional control parameter x_count_limit added to the list shown in Fig. 4. For 
similar reasons, a corresponding control parameter y_count_limit may also be added 
for the y-dimension. At this point, the position controller 114 increments y_position 
by the value of y_increment and determines a y_pixel value identifying a next line of 
pixels of the original image that may be used to generate the next line of the reduced 
size image. Thus, the pixels in the x-dimension of a current line are interpolated 
while the pixels in the y-dimension that are skipped and are discarded to generate the 
reduced size image. 

The x_count_limit and y_count_limit may be used for effectively cropping the 
original image on the right hand and bottom sides, respectively, when the the right or 
bottom margins are not to be included with the reduced size image, for example. It 
should be appreciated that the reduction ratio from the original image size to the 
reduced image size may be large, and therefore the information available in so many 
lines of the original image may far exceed the capability to display such information 
within the reduced size image, and in particular when the purpose for generating a 
thumbnail is merely for ease of documents identification by structure or shape. 

[0034] Fig. 6 shows an example where line 4 of the original image and 
pixels 3-10 (interpolation__size equal 8) are selected for interpolating a first pixel 
(x_count equals 0 and y_count equal to 0) of the reduced size image. The position 
controller 114 retrieves pixels 3-10 of line 4 of the original image from the memory 
108 and the interpolator 112 generates a corresponding pixel in the reduced size image 
by multiplying each of the pixels 3-10 by a corresponding weight value, summing the 
results of the multiplications and dividing the summed result by a value corresponding 
to the interpolation^ average value. Depending on the quality of the reduced size 
image that is desired and the desired speed of the interpolation process, all the weights 
may be set equal to a value of 1 so that the interpolator 112 merely sums the pixel 
values for the pixels 3-10 without any multiplication. Since the interpolation_size is a 
power of two (2 3 ) in this particular example, the division by the value corresponding 
to the interpolation_ average may be easily obtained by simply right shifting the sum 
by 3 bits, for example if the LSB is on the right. If the interpolationsize is 
constrained to only be a power of 2, the interpolation_average value may be a value 
that is equal to the number of right shifts to achieve the division process, for example. 
In this way, the speed of the interpolation process may be increased which in turn 
reduces the amount of time required to generate the reduced size image. 
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[0035] Fig. 7 shows the current x__position being updated to a next current 
x_position by incrementing the current x_position value by the x_increment value. 
Fig. 7 shows that the x_increment value is slightly greater than 5 pixel positions 
resulting in the next current x ^position value being slightly greater than the position of 
pixel 7. Thus, the x_pixel value is set to 7 and pixels 7-14 are selected by the position 
controller 1 14 to generate the next pixel of the reduced size image. As shown in Fig. 
7, pixels 7-10 are used twice. Once when grouped together with pixels 3-10 and again 
when grouped together with pixels 7-14. Thus, pixels 7-10 are used to generate two 
pixels in the reduced size image. The xincrement value may be set so that there is no 
case where a pixel is used more than twice to generate the reduced size image. 

[0036] Fig. 8 shows an x_increment value so that x_position is nearest to 
pixel 12. In this case, pixel 1 1 is skipped over so that pixel 1 1 does not contribute to 
any of the pixel values in the reduced size image. 

[0037] Fig. 9 shows a situation where x_position is near the line_width 
value. As shown, x_position is nearest to pixel 3896. However, when the position 
controller 114 attempts to retrieve a number of pixels of the original image specified 
by the interpolation__size parameter, which for this example has a value of 8, only 
pixels 3896-3899 are available in the original image. In this case, pixels 3896-3899 
are selected and pixel 3899 is replicated until there are enough pixel values for the 
interpolator to generate the pixel of the reduced size image. Instead of replicating the 
last pixel, the position controller 1 14 or the interpolator 112 may simply repeatedly 
used the last pixel. If the line_width value is set so that a sufficient number of pixels 
in the original image beyond the line_width are available, then the replication process 
is not required and the position controller 114 may retrieve the pixels in the original 
image that is beyond the line_width value for the interpolation process. 

[0038] Fig. 10 shows a situation where x_position plus x_increment exceeds 
line_width. In this case, x ^position is reset to x_start and y_position is incremented 
by y increment. Y_pixel is selected to a line that has a closest position y-dimensional 
value to yj>osition. As shown, line 1 1 is selected and pixels 3-10 of row 1 1 are 
retrieved by the position controller 1 14 to generate the next pixel of the reduced size 
image. As mentioned above, when the y_position value is incremented, x_count is set 
to a predetermined value such as 0 and the y_couht is incremented by 1, for example. 
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Thus, for the example shown in Fig. 10, x_count is equal to 0 and y_count is equal to 
1. 

[0039] If after incrementing y_count by 1 and y_count exceeds a 
y_count_limit, then the a maximum number of lines in the reduced size image is 
exceeded. In this case, the reduced size image generation process is completed and 
the reduced size image is output to a following process. If pixels of the reduced size 
image was output as they are generated, then the reduced size image generation 
process ends or begins generating another reduced size image. The y_count_limit 
parameter may be optional. If not used, then the reduced size image generation 
process merely continues until the number of lines in the original image is exhausted. 

[0040] The pixels for the reduced size image that are generated by the 
interpolator 1 12 may first be stored in the memory 108 and output through the 
input/output port 1 16 to a next stage of process after the complete reduced size image 
is generated. However, depending on the implementation, the pixels of the reduced 
size image may be output by the input/output port 1 16 to following processes as each 
of the pixels of the reduced size image is being generated by the interpolator 112. 

[0041] While the above discussion described the functions performed by the 
various hardware components such as the position controller 114 and the interpolator 
112, these function can be implemented in software executing in an appropriate 
processor such as the CPU 106 for example. In such an implementation, the software 
determines which data points (pixels) in the original image to use for interpolation to 
generate a corresponding pixel in the reduced size image. The control parameters 
such as x start, y start, x_position, y_position, xincrement, y_increment, x_size, 
y_size, line_width, x_count, y_count, x count limit, y _count_limit, etc. may be 
variables manipulated by the software to implement the reduced size image generation 
process. The process implemented by either hardware or software would be 
essentially the same and may be outlined by a flowchart as discussed below. 

[0042] Fig. 1 1 shows a flowchart for a process for generating a reduced size 
image. In step SI 00, control parameters such as shown in Fig. 4 are received for 
controlling the reduced size image generation and the process goes to step SI 02. As 
noted above, these control parameters may be pre-stored and thus step SI 00 would be 
unnecessary. In step SI 02, a starting position relative to a predetermined reference 
point in an original document is obtained by setting a value of a current x_position 
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and a value of a current y__position to values of x_start and y_start parameters, 
respectively. As discussed above, a pixel in the original image that is closest to a 
position identified by the current x_position and the current y_position is selected as a 
starting pixel. Parameters x j>ixel and y_pixel are also set corresponding to a pixel 
number and a line number that are closest to the x_position and y_position. The 
x_pixel and y_pixel values are used to precisely identify pixels that are used to 
generate a specific pixel in the reduced size image. After step SI 02, the process goes 
to step SI 04. 

[0043] In step SI 04, a test is made whether there is sufficient number of 
pixels in the original image of the current line to complete the interpolation process. 
If insufficient, the process goes to step SI 06; otherwise, the process goes to step SI 08. 
In step SI 06, the last pixel of the current line is replicated until there is sufficient 
number of pixels for the interpolation process, and the process continues to step SI 08. 
As mentioned above, the replication of pixels can be done on a line-by-line basis 
during the interpolation process rather than as a separate preparatory step SI 08. In 
situations where memory resources are scarce, it may be preferable to hang on to the 
last pixel on the current line rather than pre-calculate and store a number of replicated 
pixels for several output lines. 

[0044] In step SI 08, the process selects a number of pixels in the original 
image along the current line (x-dimension) that is specified by the interpolation_size 
parameter and the interpolation process generates a pixel of the reduced size image. 
The interpolation process may multiply each of the selected pixels by a corresponding 
weight and summing the multiplication results and dividing the sum by a value 
corresponding to the interpolation_shift parameter. For increased speed, all the 
weights may be set equal to 1, the interpolation_size parameter may be set to a power 
of 2 and the interpolation_shift parameter may be equal to a number of bindery shifts 
to obtain an average value of the selected pixels. Then, the process goes to step SI 09. 
In step SI 09, the current x_position is incremented by x_increment to obtain a next 
current x ^position and the process goes to step SI 10. 

[0045] In step S 1 10, a test is made whether the end of the current line has 
been reached by comparing the next current x ^position with the value of the 
line_width parameter, or when the x count of pixels exceeds xcountjimit, if 
provided, whichever occurs first. If the next current x_position is less than or equal to 
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the value of the line_width parameter, the end of the current line is not reached, and 
the process returns to step SI 04; otherwise, the end of the current line is reached and 
the process goes to step SI 12. In step SI 12, a test is made whether all the pixels of 
the reduced size image have been generated. If all the pixels are generated, the 
process goes to step SI 16 and ends; otherwise, the process goes to step SI 14. The 
control parameters may include a total number of pixels of the reduced size image. If 
this parameter is provided, a count of the number of pixels generated may be 
maintained and when this count is equal to the total required number of pixels, the test 
in step SI 12 becomes successful and the process goes to step SI 16. In step SI 14, the 
x ^position parameter is set to the value of x_start and the y_position parameter is 
incremented by the value of y_increment. Then, the process returns to step SI 04. 

[0046] The above described method is performed for each of the color 
components of the original image in YCC color space. If the chromatic values have 
been subsampled by a factor of 2: 1, for example, then the x increment, y_increment, 
interpolation_size and line_width parameters should be correspondingly reduced to 
half their values, and the interpolation^ average parameter should be reduced by one, 
if it corresponds to a number of right shifts, to normalize the interpolation sum. 

[0047] While the invention has been described in conjunction with 
exemplary embodiments, these embodiments should be viewed as illustrative, not 
limiting. Various modifications, substitutes or the like are possible within the spirit 
and scope of the invention. In particular, for images spanned by more than two- 
dimensions such as three-dimensional images, x-y image planes in a portion of the z- 
dimension maybe discarded thus selecting remaining x-y image planes for processing. 
X_size by y_size blocks within each of the selected x-y planes may be processed by 
averaging each of the selected blocks or various other two-dimensional interpolation 
processes may be used to generate a data point of the reduced size image. 

[0048] Additionally, while the parameters x_, y_start; x_, y_position; x_, 
y_increment are discussed as having values corresponding to a predetermined 
reference point in the original document, these parameters may simply specify 
positions in terms of pixels where the top left pixel is the predetermined reference 
point. In this case, x_, y_ start would be the number of pixels in the x_ and y_ 
dimensions and x_, y_ increment would be a pixel count in the x_ and y_ dimension. 
The x_position and y_position would be identical to x_pixel and y_pixel. 



